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(54) Video service system 

(57) A video server encapsulates video program 
data, encoded by the scalable coding method, into 
packets, assigns a flag to the packet for each layer and 
transmits the packet to a video quality control equip- 
ment (20) existing on an edge of a network branching to 
client terminals (11 and 12). The video quality control 
equipment (20) duplicates and converts video program 



data, encoded by the scalable coding method, accord- 
ing to quality modes demanded from the client terminals 
(11 and 12), and serves the video program data thus 
duplicated and converted to the respective client termi- 
nals (11 and 12). 
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Description 

BACKGROUND OF THE INVENTION 

[0001 ] The present invention relates to a serving sys- 
tem for serving a video program including video data, 
acoustic data or the like, and particularly relates to an 
apparatus for encapsulating a broadcasting type video 
program into packets and transmitting them. 
[0002] As a conventional video data transmission 
apparatus, there is hitherto known a system for encap- 
sulating video data into packets for each wavelet band- 
width as disclosed in JP-A-7-15609 (laid-open on 
January 17, 1995). This prior-art technology is intended 
to provide video data transmission method and video 
data transmission apparatus, video data reception 
apparatus in which a video data is transmitted accord- 
ing to a transmission capability of a network for video 
data transmission on a video data reception side and a 
decoding performance of a video data reception appa- 
ratus even when the transmission capability of the net- 
work for video data transmission on the video data 
reception side and the decoding performance of the 
video data reception apparatus are inferior to a trans- 
mission capability of a network for video data transmis- 
sion on a video data transmission side and a coding 
performance of a video data transmission apparatus. As 
a system that may be realized in actual practice, in a 
video data transmission apparatus, a video data is 
encapsulated into packets for each wavelet bandwidth, 
a predetermined flag is set for each packet and a result- 
ant packet is then transmitted. When a network for 
transmitting video data is based on the ATM (Asynchro- 
nous Transfer Mode), video data is transmitted with pri- 
ority information added to a header of a cell. On a 
network for transmitting video data, upon congestion of 
the network, a cell with a high priority is preferentially 
transmitted. A video data reception apparatus is permit- 
ted to reproduce video data according to a processing 
ability on the reception side by selecting and decoding 
only necessary video data, according to a decoding per- 
formance, based on a flag of received video data. 
[0003] On the other hand, as a system for serving 
video data by using a network, there is known a multi- 
cast system using an IP (Internet Protocol) network. 
While the IP multicast system which serves video data 
serves same video data to a plurality of reception appa- 
ratus, streams of the number corresponding to the 
number of reception apparatus are not served from a 
video data serving apparatus but the video stream 
branches to a necessary number at a tree-like branch- 
ing point In the network, thereby resulting in the same 
video data being served to a plurality of reception appa- 
ratus. Specifically, when there are provided two video 
data reception apparatus as shown in FIG. 11, two 
video data streams are not served from a video data 
server as a transmission apparatus but a video data 
stream is duplicated at an edge router on a network 



where the network finally branching to the two client ter- 
minals, thereby resulting in the same video data stream 
being served to the two client terminals as reception 
apparatus. The video data is transmitted as described 
5 above, whereby a limited transmission capacity of the 
network may be utilized effectively. 
[0004] J P-A-4-003684 (laid-open on January 8. 1 992) 
discloses an apparatus for encoding a motion picture 
with a variable rate for use in a videophone, video con- 
ic ference or the like. 

[0005] JP- A-9- 1 1 6551 (laid-open on May 2, 1 997) dis- 
closes a data packet transmission method and appara- 
tus in which data packets are transmitted/received 
through an ATM network. 
15 [0006] JP-A-10-023418 (laid-open on January 23. 
1998), JP-A-9-247676 (laid-open on September 19, 

1997) and JP-A-10-032608 (laid-open on February 3. 

1998) disclose a packet video rate conversion appara- 
tus, which is particularly adapted for video conference 

20 communication over a network. 

SUMMARY OF THE INVENTION 

[0007] However, when the above-described conven- 
es tional technology is applied to a video program service 
system, the following inconveniences may be encoun- 
ted. 

[0008] When video data is wavelet-coded and trans- 
mitted, the video transmission apparatus, according to 

so JP-A-7-15609 assigns a flag to a data transmitting 
packet for each band and transmits resultant data, the 
reception apparatus decodes and reproduces only data 
having a packet with a necessary flag based on a repro- 
duction capability. For example, let us assume a video 

35 program service system in which the charging is graded 
by a level of reproduction quality (picture quality, 
smoothness of motion, etc.) of video data. Even when a 
reception apparatus has a video data reproduction 
capability high enough to reproduce full data transmit- 

40 ted from the video program service system, a viewer 
may not desire such a high reproduction quality. In such 
a case, it is desired that video data should be repro- 
duced with a reproduction quality which meets with 
viewer's requirements, in addition to the processing 

45 capability of the reception apparatus. However, conven- 
tionally, the reproduction quality of video data depended 
upon only the processing capability of the reception 
apparatus and the video data could not be reproduced 
with the reproduction quality which meets with viewer's 

so requirements. 

[0009] Next, when there are provided a plurality of 
video program reception apparatus, according to the 
conventional IP multicast system, video data is dupli- 
cated at a branching point, and the same video data is 

55 served to a plurality of reception apparatus. Therefore, 
the conventional IP multicast system may not be able to 
serve video programs with different qualities to a plural- 
ity of video program reception apparatus. Moreover, 
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according to the conventional IP multicast system, when 
a plurality of video program reception apparatus 
demand to transmit the same video program with differ- 
ent reproduction qualities, video data of the same qual- 
ity, in other words, video data of the same data 5 
transmission rate is transmitted to a plurality of video 
program reception apparatus. As a result, a plurality of 
video program reception apparatus cannot reproduce a 
video program with different quality levels depending on 
viewer's requests. w 
[001 0] Therefore, an object of the present invention is 
to provide a video program transmission and reception 
system in which a video program with a plurality of qual- 
ities can be reproduced from one video stream when a 
video program is transmitted from a video server for 15 
reproduction. 

[0011] It is another object of the present invention to 
provide a video program transmission and reception 
system in which, when there are provided a plurality of 
video program reception apparatus, a video stream with 20 
a necessary quality is duplicated by an edge router at 
edges branching to the plurality of reception apparatus 
on the network and served thereto. 
[0012] According to an aspect of the present inven- 
tion, in a video program service system, an outputted 25 
video program is layered-coded, layered-coded video 
and acoustic data are stored and held in a video server 
as a video program output apparatus, the layered- 
coded data are encapsulated into packets for service, a 
flag is assigned to the to-be-served packets for each 30 
layer and resultant packets are transmitted. Further, a 
data rate of the layered-coded data is measured for 
each layer, a program data rate of each to-be-served 
video program quality is calculated and stored in the 
video program output apparatus, and information on 35 
relation between the video data rate for each to-be- 
served video program quality and the flag of the packet 
for transmitting the data necessary for reproducing each 
to-be-served video program quality is transmitted simi- 
larly to the above-described video data. 40 
[0013] According to another aspect of the present 
invention, in a video program reception apparatus, a 
received video program quality is demanded and a 
quality of a to-be-received video program is designated. 
[0014] According to another aspect of the present 45 
invention, in a reception apparatus, picture sizes of a 
plurality of displayed video programs are designated 
and displayed individually, and a video program which is 
displayed in maximum size among a plurality of dis- 
played video programs is demanded to be served with a so 
high quality so that video programs of sizes other than 
the maximum size are demanded to be served with a 
low quality. 

[0015] According to another aspect of the present 
invention, in a reception apparatus, display positions of 55 
a plurality of displayed video programs are designated 
and displayed individually, a video program which is dis- 
played on the front plane among a plurality of displayed 



video programs is demanded to be served with a high 
quality, and video programs displayed on planes other 
than the front plane are demanded to be served with a 
low quality. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0016] 

FIG. 1 is a block diagram showing a multi-quality 
layered video service system according to an 
embodiment of the present invention; 
FIG. 2 is a block diagram showing an encoding sec- 
tion in an embodiment of the present invention; 
FIG. 3 is a diagram showing a relationship between 
coded layers and flags; 

FIG. 4 is a diagram showing a relationship between 
a motion prioritized quality and a data transmission 
rate provided by a video server according to an 
embodiment of the present invention; 
FIG. 5 is a diagram showing a relationship between 
a resolution prioritized quality and a data transmis- 
sion rate provided by a video server according to an 
embodiment of the present invention; 
FIG. 6 is a pictorial representation illustrating a 
state in which examples of video programs that can 
be selected are displayed on a display screen of a 
client terminal in an embodiment of the present 
invention; 

FIG. 7 is a pictorial representation illustrating a 
state in which examples of video quality that can be 
selected are displayed on a display screen of a cli- 
ent terminal in an embodiment of the present inven- 
tion; 

FIG. 8 is a pictorial representation illustrating a 
state in which a client terminal displays received 
video programs in different display size in an 
embodiment of the present invention; 
FIG. 9 is a pictorial representation illustrating a 
state in which a client terminal displays received 
video programs in such a manner that display posi- 
tions overlap with each other in an embodiment of 
the present invention; 

FIG. 10 is a schematic diagram showing a system 
for multi-casting layered coded data in a multi-qual- 
ity layered video service system in an embodiment 
of the present invention; and 
FIG. 11 is a diagram showing a conventional IP 
multi-cast system. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

[0017] An embodiment according to the present 
invention will hereinafter be described with reference to 
the drawings. FIG. 1 of the accompanying drawings is a 
block diagram showing a multi-quality layered video 
service system according to an embodiment of the 
present invention. 
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[0018] As shown in FIG. 1, the multi-quality layered 
video service system according to the present invention 
comprises a video server 30 for serving a video pro- 
gram composed of video and audio data or the like, a 
video quality control equipment 20 capable of changing 
a quality of video program on the network and a client 
10 for receiving and reproducing a video program based 
on a video program demand. More in detail, the video 
server 30 comprises an encoding section 40 for encod- 
ing an analog video program, a data output control sec- 
tion 31 for controlling the data output, a multi-quality 
layered video section 32 for storing and holding coded 
program data, a quality index attachment section 33 and 
a data output section 34. Also, the video quality control 
equipment 20 comprises a quality demand control sec- 
tion 21 , a duplication control section 22 and a data dis- 
tribution control section 23. Further, the client 10 
comprises a plurality of client terminals. In this embodi- 
ment, a plurality of client terminals assume two client 
terminals. In this assumption, an operation of a multi- 
quality layered video service system according to the 
embodiment of the present invention will be described 
hereinafter. 

[0019] The multi-quality layered video service system 
shown in FIG. 1 is a system for serving the same video 
program based on video program output demands from 
one or a plurality of clients 10. In the video server 30, ini- 
tially, the encoding section 40 encodes the analog video 
program by a scalable coding method, the multi-quality 
layered video section 32 stores and holds layered- 
coded video program data, and the quality index attach- 
ment section 33 stores and holds coded information 
such as a flag for identifying each layer and a data 
transmission rate of each layer. 

[0020] FIG. 2 is a block diagram showing the manner 
in which video program data is coded and stored and 
coded information is stored. In the encoding section 40 
shown in FIG. 2, initially, a data input device 35 inputs 
data for designating a scalable coding method. 
[0021] FIG. 3 shows examples of data inputted from 
the data input device 35. The example of FIG. 3 shows 
the manner in which pictures of I picture, P picture and 
B picture are coded by two layers of a low frequency 
component (L) and a high frequency component (H), 
and also shows the manner in which flags 7 to 2 are 
assigned to each layered data. As shown in FIG. 2, a 
data signal 81 indicative of the number of layers and the 
flag inputted from the data input device 35 is transmitted 
through a CPU (central processing unit) 36 to the scala- 
ble coding section 37 and the quality index attachment 
section 33 as layer number data 82. Flag data is trans- 
mitted to the quality index attachment section 33 as flag 
data 83. After the layer number is set in the scalable 
coding section 37, the video server 30 receives, at a 
video input interface (l/F) 38, the analog video signal 80 
for encoding by a scalable coding method. The video 
input interface 38 transmits the video program thus 
received to the scalable coding section 37 as a video 



program signal 84. The scalable coding section 37 
encodes the video program signal 84 by the scalable 
encoding method designated by the aforementioned 
data input device 35, and transmits the data 85 encoded 

5 by the scalable coding to a data calculation section 39. 
The data calculation section 39 calculates a data trans- 
mission rate for each layer, and transmits the data trans- 
mission rate thus calculated to the quality index 
attachment section 33 as a data transmission rate infbr- 

10 mation signal 86 of each layer. Also, the data calculation 
section 39 transmits the data 85 encoded by the scala- 
ble coding to the multi-quality layered video section 32. 
The mutuality layered video section 32 stores and 
holds the data 85 encoded by the scalable coding thus 

15 transmitted. The quality index attachment section 33 
forms combinations of a total data transmission rate of 
each video quality and flags necessary for realizing the 
reproduction of each quality from the layer number data 
82 inputted from the data input device 35. the flag data 

20 83 and each layer data transmission rate information 86 
from the data calculation section 39. 
[0022] FIGS. 4 and 5 show tables of flags necessary 
in respective qualities and total data transmission rates 
thus formed. A study of FIGS. 4 and 5 reveals that two 

25 kinds of quality modes of motion prioritized mode and 
resolution prioritized mode are set in this embodiment. 
[0023] In the motion prioritized mode shown in FIG. 4, 
there are set motion prioritized quality modes of six 
stages ranging from a motion prioritized quality mode 1 

30 to a motion prioritized quality mode 6. Flags 7 to 2 in 
FIG. 4 represent low frequency components and high 
frequency components of respective I, P and B pictures 
as mentioned before in FIG. 3. While reference numer- 
als 1 are attached to all components from the flags 7 to 

35 2 in the quality of the motion prioritized mode 1, for 
example, these reference numerals 1 mean that the 
quality of the motion prioritized mode 1 contains six 
components of low frequency components and high fre- 
quency components of all I, P, B pictures. Also, in the 

40 quality of the motion prioritized mode 3, for example, the 
I picture contains both of the low frequency components 
and the high frequency components, and the P picture 
and the B picture contain only the low frequency compo- 
nents. A total data transmission rate on the right-hand 

45 end column of the table shown in FIG. 4 represents a 
value which results from accumulating respective layer 
data transmission rates from the data calculation sec- 
tion 32 in FIG. 2. In the quality of the motion prioritized 
mode 1 . for example, there is illustrated the total data 

so transmission rate of 6.0 Mbit/s. In the quality of the 
motion prioritized mode 4, for example, there is illus- 
trated the total data transmission rate of 4.2 Mbitfs. 
[0024] In the resolution prioritized mode shown in FIG. 
5, there are set resolution prioritized quality modes of 

55 six stages ranging from the resolution prioritized mode 1 
to the resolution prioritized mode 6. The flags and the 
total data transmission rate in FIG. 5 represent mean- 
ings similar to those described in FIG. 4. That is, while 
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the quality of the resolution prioritized mode 3 contain 
the low frequency components and the high frequency 
components of I and P pictures, the B picture contains 
neither the low frequency component nor the high fre- 
quency component. Also, a total data transmission rate 
means that there exist data of 5.0 Mbit/s. 
[0025] Next, the manner in which video programs are 
served in response to video program serving demands 
from the two client terminals will be described with ref- 
erence to FIG. 1. 

[0026] Initially, the video program client terminals 1 1 
and 12 issue desired video program serving demands 
to the video server 30 by using the video program serv- 
ing demand signals 51, 52. FIG. 6 shows a state in 
which examples of video programs that can be selected 
from the video program guide are displayed on the client 
terminals 1 1 and 12. Initially, a viewer selects a desired 
video program on the video program selection picture 
shown in FIG. 6. For example, let it be assumed that the 
client terminals 11 and 12 select a video program A. In 
this case, the client terminals 1 1 and 12 issue a serving 
demand of the video program A to the video server 30. 
When the video program client terminals 11 and 12 
issue the video program serving demands to the video 
server 30, the video program serving demands are 
transmitted through the quality demand control section 
21 within the video quality control equipment 20 existing 
on the network to the data output control section 31 
within the video server 30 as the video program serving 
demand signal 60. The quality demand control section 
21 stores and holds information of video programs 
demanded by the video program client terminals 1 1 and 
12 in the internal memory. That is, the video quality con- 
trol equipment 20 stores and holds information indicat- 
ing that the video program A is demanded by the client 
terminals 11 and 12. The quality demand control sec- 
tion 21 transmits data indicative of making a duplication 
to serve video program data to a duplication control sec- 
tion 22 by using a control signal 62. Further, a data dis- 
tribution control section 23 is controlled by a control 
signal 63 in such a manner that data duplicated by the 
duplication control section 22 is served to the client ter- 
minals 11 and 12. 

[0027] When the data output control section 31 within 
the video server 30 receives the video program service 
demand signal 60, the data output control section 31 
instructs the quality index attachment section 33, which 
stores and holds coding information such as flags of 
respective layers in which video programs are coded 
and data transmission rates for respective layers, by 
using a control signal 72 in such a manner that the qual- 
ity index attachment section 33 outputs coding format 
information. When the quality index attachment section 
33 receives the coding format information output 
instruction signal 72 from the data output control section 
31, the quality index attachment section 33 transmits 
the coding format information thus stored and held such 
as the flags of the respective layers and the data trans- 



mission rates of the respective layers, i.e. information 
described in FIGS. 4 and 5 to the data output section 34 
as a coded information signal 74. The data output sec- 
tion 34 encapsulates the coding format information 

5 received from the quality index attachment section 33 
into a packet, and transmits the same to the video qual- 
ity control equipment 20 as the coding format informa- 
tion signal 61. The duplication control section 22 within 
the video quality control equipment 20 stored and holds 

70 the coding format information signal 61 received from 
the data output section 34, i.e. the coding information 
such as the flags of the respective quality modes and 
the data transmission rates of the respective quality 
modes in the internal memory, duplicates the coding for- 

15 mat information, and transmits duplicated coding format 
information signals 64 and 65 to the data distribution 
control section 23. The data distribution control section 
23 transmits the coding format information transmitted 
from the duplication control section 22 to the client ter- 

20 minals 1 1 and 12 as the coding format information sig- 
nals 66 and 67. 

[0028] When the client terminals 11 and 12 receive 
the coding format information signals 66 and 67, the cli- 
ent terminals 11 and 12 display the picture shown in 

25 FIG. 7 on the display screen. Since the user initially 
demands the service of the video program A, there are 
displayed a quality mode that can be provided in the 
video program A and a data transmission rate on the 
display screen. Then, the user selects a quality mode 

30 and a reception data transmission rate corresponding to 
the video program A shown in FIG. 7. 
[0029] In actual practice, the user selects the right- 
hand side data transmission rate portion on the picture 
of FIG. 7 displayed on the display screen of the client 

35 terminals, i.e. a quality of 6.0 Mbit/s at the motion prior- 
itized quality mode 91 (i.e. "motion prioritized mode 1 " in 
FIG. 4) is selected in the client terminal 1 1 . Also, a qual- 
ity of 5.7 Mbit/s at the resolution prioritized quality mode 
92 (i.e. "resolution prioritized mode 2" in FIG. 5) is 

40 selected in the client terminal 12. In this case, the client 
terminals 1 1 and 12 issue the video program demands 
with the selected quality modes to the video server 30 
by using the demand signals 51 and 52. 
[0030] When the client terminals 1 1 and 12 issue the 

45 video program demands with the quality modes 
selected by the respective client terminals 1 1 and 12 to 
the video server 30. a video program output instruction 
is supplied through the quality demand control section 
21 within the video quality control equipment 20 existing 

so on the network to the data output control section 31 
within the video server 30 as the video program service 
demand signal 60. The quality demand control section 
21 stores and holds quality mode information of the 
video programs demanded by the video program client 

55 terminals 1 1 and 12 in the internal memory. The quality 
demand control section 21 stores and holds the infor- 
mation such that the client terminal 1 1 ordered the qual- 
ity mode information indicating that the quality mode 
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video program of 6.0 Mbit/s in the motion prioritized 
quality mode of the video program A in the internal 
memory, and the information such that the client termi- 
nal 12 ordered the quality mode information indicating 
that the quality mode video program of 5. 7 Mbit/s in the 5 
resolution prioritized quality mode of the video program 
A in the internal memory. 

[0031] Also, the quality demand control section 21 
transmits the quality information demanded by the video 
program client terminals 11 and 12 to the duplication 10 
control section 22 by using the control signal 62. Fur- 
ther, the quality demand control section 21 controls the 
data distribution control section 23 by the control signal 
63 in such a manner that the data distribution control 
section 23 may serve data generated by the duplication is 
control section 22 to the client terminals 1 1 and 12. 
[0032] When the data output control section 31 within 
the video server 30 receives the video program service 
demand signal 60, the data output control section 31 
transmits a demanded video program output instruction 20 
to the multi-quality layered video section 32 which 
stores and holds the video program data encoded by 
the scalable coding method through the control signal 
71. When the multi-quality layered video section 32 
receives the video program output demand signal 71 25 
from the data output control section 31 , the multi-quality 
layered video section 32 transmits the stored and held 
video program data encoded by the scalable coding 
method to the data output section 34 as the coded data 
signal 73. The data output section 34 encapsulates the 30 
layered-coded data received from the multi-quality lay- 
ered video section 32 into the packet by assigning the 
flag of each layer, and transmits the resultant packets to 
the video quality control equipment 20 as the coded 
data signal 61 . Incidentally, as a system for assigning 35 
the flag of each layer, there may be used a TOS (Type of 
Service) field within the header of IP packet when the 
data encoded by the scalable coding method is encap- 
sulated into the IP packet, for example. 
[0033] The duplication control section 22 within the 40 
video quality control equipment 20 compares the video 
program quality modes, demanded by the client termi- 
nals 11 and 12, transmitted from the quality demand 
control section 21 with the coding format information ini- 
tially received from the video server 30, and forms 45 
(duplicates) layered-coded data necessary for serving 
the video programs of the quality modes demanded by 
the client terminals 1 1 and 1 2 from the received layered- 
coded data 61. 

[0034] In this embodiment, since the client terminal 1 1 so 
demands the quality mode of 6.0 Mbit/s in the motion 
prioritized quality mode of the video program A, the 
duplication control section 22 duplicates data of packets 
having the flags 7 to 2 (i.e. all packets), and transmits 
the data thus duplicated to the data distribution control 55 
section 23 as the video program data 64 demanded 
from the client terminal 1 1 . Accordingly, in this case, the 
quality mode need not be changed and the received 



data is transmitted to the data transmission section 23 
as the demanded video program data 64 as it is. Also, 
since the client terminal 12 demands the quality mode 
of 5.7 Mbit/s in the resolution prioritized mode of the 
video program A, the duplication control section 22 
duplicates data other than data of the high frequency 
component of the B picture, i.e. data except the packet 
having the flag 2 from the received data encoded by the 
scalable coding method 61 , and transmits the data thus 
duplicated to the data distribution control section 23 as 
the video program data demanded from the client termi- 
nal 12. The data distribution control section 23 transmits 
the data encoded by the scalable coding method 64 and 
65 transmitted from the duplication control section 22 to 
the client terminals 11 and 12 as the video program 
service data signals 66 and 67. 
[0035] FIG. 10 illustrates the state in which the video 
program A is multicast on the client terminal 1 1 which 
demands the quality mode of "motion prioritized quality 
mode 1" selected from the video server 30 and the cli- 
ent terminal 12 which demands the quality mode of 
"resolution prioritized quality mode 2" selected from the 
video server 30. As described above, the high fre- 
quency component of the B picture is not transmitted to 
the client terminal 12. The client terminals 11 and 12 
receive the video program data signals 66 and 67 out- 
putted from the video quality control equipment 20. and 
display the video program data thus received on the dis- 
play screens thereof. 

[0036] White the display size of video program dis- 
played by the reception terminal has not been described 
so far, it is possible to automatically set the quality mode 
of the received video program based on the display size 
of video program displayed on the client terminal. For 
example, if the display size of the video program dis- 
played on the client terminal is less than a certain size, 
it is possible to construct the system in such a manner 
that the system may automatically receive video pro- 
gram data of the quality modes having only the low fre- 
quency components of the I, P, B pictures, i.e. the video 
program quality of the motion prioritized quality mode 4. 
Also, the system may be extended even when the client 
terminal receives a plurality of video programs. 
[0037] FIGS. 8 and 9 are respectively pictorial repre- 
sentations showing the manner in which video pro- 
grams are displayed on the display screen of the client 
terminal when the client terminal receives a plurality of 
(two video programs) video programs. 
[0038] FIG. 8 shows the manner in which two video 
programs are received through the coded data signal 
66, i.e. a video program 1 denoted by reference numeral 
101 is reproduced and displayed on a small window and 
a video program 2 denoted by reference numeral 102 is 
reproduced and displayed on a large window. When the 
display sizes of the received video programs are differ- 
ent as described above, the video server 30 may be 
demanded by the video program demand signal 51 so 
as to serve video programs in such a manner that a 
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video program which is to be displayed in maximum size 
may be displayed with a video program quality desig- 
nated by the user or with the best quality that can be 
provided and that video programs which are to be dis- 
played in other sizes may be displayed with a quality 5 
lower than that of the video program displayed in maxi- 
mum size or with the lowest quality that can be pro- 
vided. 

[0039] FIG. 9 shows the manner in which a video pro- 
gram denoted by reference numeral 104 is reproduced 10 
and displayed on the front window and a video program 
1 denoted by reference numeral 103 is reproduced and 
displayed on the rear window. When the displayed posi- 
tions of the received video programs on the display 
screen are different as described above, the video is 
server 30 may be demanded by the video program 
demand signal 51 so as to serve video programs in 
such a manner that a video program which is to be dis- 
played on the front may be displayed with a video pro- 
gram quality designated by the user or with the best 20 
quality that can be provided and that video programs 
which are to be displayed at other positions may be dis- 
played with a quality lower than that of the video pro- 
gram displayed on the front or with the lowest quality 
that can be provided. 25 
[0040] As described above, according to the multi- 
quality layered video service system in one aspect of 
the present invention, a video program which is to be 
served is layered-coded, the flag is assigned to each 
layer, and then the video program is served. Also, in 30 
order to reproduce video programs with a plurality of 
quality modes, information indicating a combination of 
flags for serving data necessary for reproducing video 
programs with respective quality modes are served 
together with video programs data. Therefore, there can 35 
be achieved the effects to provide the video program 
transmission and reception system capable of repro- 
ducing video programs with a plurality of quality modes 
from one stream data which results from video pro- 
grams data encoded by the scalable coding method. 40 
[0041] Having described a preferred embodiment of 
the invention with reference to the accompanying draw- 
ings, it is to be understood that the invention is not lim- 
ited to that precise embodiment and that various 
changes and modifications could be effected therein by 45 
one skilled in the art without departing from the spirit or 
scope of the invention as defined in the appended 
claims. 

Claims so 
1 . A video program serving system comprising: 
a video server (30); and 

a video quality control equipment (20) con- 55 
nected to said video server (30) and a plurality 
of client terminals (11, 12) through a network, 
wherein said video server (30) includes means 



(34) for encapsulating video data, encoded by 
a scalable coding method, into packets and 
outputting said packet with a flag for each layer, 
and said video quality control equipment (20) 
includes means (22) for duplicating data, which 
results from combining encoded data of differ- 
ent layers, from one video data, encoded by the 
scalable coding method, received from said 
video server (30) and for transmitting it for each 
client terminal. 

2. A video program serving system according to claim 
1, wherein said video server (30) includes means 
(33) for measuring a combination of said flags and 
data transmission rates of encoded data corre- 
sponding to said combination and means (34) for 
transmitting information concerning said measured 
data transmission rate through said video quality 
control equipment (20) to a client terminal (11,1 2). 

3. A video server (30) comprising: 

means (34) for encapsulating video data, 
encoded by a scalable coding method, into 
packets and outputting said packet with a flag 
assigned for each layer; and 
means (33) for encapsulating information con- 
cerning a combination of flags and a data 
transmission rate of data, encoded by the scal- 
able coding method, corresponding to said 
combination into packets and outputting said 
packets. 

4. A video server (30) according to claim 3, further 
comprising means (40) for measuring a data trans- 
mission rate for each layer of said video data 
encoded by the scalable coding method. 

5. A video quality control equipment (20) comprising: 

means (22) for duplicating video programs of 
quality different for each client terminal (11, 
12), from one video data, encoded by a scala- 
ble coding method, received from a video 
server (30) and serving said duplicated video 
programs. 

6. A video quality control equipment (20) according to 
claim 5, further comprising means (22) for duplicat- 
ing data which results from combining encoded 
data of different layers for each client terminal (11, 
12), from one video data, encoded by the scalable 
coding method, received from a video server (30) 
and transmitting said duplicated data. 

7. A video program receiving apparatus (1 0) compris- 
ing: 
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means (11. 12) for receiving information con- 
cerning a data transmission rate obtained 
when a video program transmitted from a video 
server (30) is displayed with a first quality mode 
and information concerning a data transmis- 5 
sion rate obtained when said video program is 
displayed with a second quality mode lower 
than said first quality mode and displaying said 
information on a display screen; and 
means for selecting said first quality mode and 10 
said second quality mode from said display 
screen. 

8. A video program receiving apparatus according to 
claim 7, further comprising: 15 

means (11, 12) for receiving first and second 
video programs from said video server (30) 
through a network and displaying said first and 
second video programs on said display screen 20 
in a multi-window fashion; and 
means for demanding that said first video pro- 
gram is served with said first quality mode and 
said second video program is served with said 
second quality mode when a window size for 25 
displaying said first video program is larger 
than a window size for displaying said second 
video program. 

9. A video program receiving apparatus according to 30 
claim 7, further comprising: 

means (11, 12) for receiving first and second 
video programs from a video server (30) 
through a network and displaying said first and 35 
second video programs on said display screen 
in a multi-window fashion; and 
means for demanding that said first video pro- 
gram is served with said first quality mode and 
said second video program is served with said 40 
second quality mode when a window for dis- 
playing said first video program is located 
ahead of a window for displaying said second 
video program. 
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(54) Video service system 

(57) A video server encapsulates video program 
data, encoded by the scalable coding method, into 
packets, assigns a flag to the packet for each layer and 
transmits the packet to a video quality control equip- 
ment (20) existing on an edge of a network branching to 
client terminals (11 and 12). The video quality control 
equipment (20) duplicates and converts video program 



data, encoded by the scalable coding method, accord- 
ing to quality modes demanded from the client terminals 
(11 and 12), and serves the video program data thus 
duplicated and converted to the respective client termi- 
nals (11 and 12). 
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Description 

BACKGROUND OF THE INVENTION 

[0001 ] The present invention relates to a serving sys- s 
tern for serving a video program including video data, 
acoustic data or the like, and particularly relates to an 
apparatus for encapsulating a broadcasting type video 
program into packets and transmitting them. 
[0002] As a conventional video data transmission io 
apparatus, there is hitherto known a system for encap- 
sulating video data into packets for each wavelet band- 
width as disclosed in JP-A-7-15609 (laid-open on 
January 17, 1995). This prior-art technology is intended 
to provide video data transmission method and video is 
data transmission apparatus, video data reception 
apparatus in which a video data is transmitted accord- 
ing to a transmission capability of a network for video 
data transmission on a video data reception side and a 
decoding performance of a video data reception appa- 20 
ratus even when the transmission capability of the net- 
work for video data transmission on the video data 
reception side and the decoding performance of the 
video data reception apparatus are inferior to a trans- 
mission capability of a network for video data transmis- 25 
sion on a video data transmission side and a coding 
performance of a video data transmission apparatus. As 
a system that may be realized in actual practice, in a 
video data transmission apparatus, a video data is 
encapsulated into packets for each wavelet bandwidth, 30 
a predetermined flag is set for each packet and a result- 
ant packet is then transmitted. When a network for 
transmitting video data is based on the ATM (Asynchro- 
nous Transfer Mode), video data is transmitted with pri- 
ority information added to a header of a cell. On a 35 
network for transmitting video data, upon congestion of 
the network, a cell with a high priority is preferentially 
transmitted. A video data reception apparatus is permit- 
ted to reproduce video data according to a processing 
ability on the reception side by selecting and decoding 40 
only necessary video data, according to a decoding per- 
formance, based on a flag of received video data. 
[0003] On the other hand, as a system for serving 
video data by using a network, there is known a multi- 
cast system using an IP (Internet Protocol) network. 45 
While the IP multicast system which serves video data 
serves same video data to a plurality of reception appa- 
ratus, streams of the number corresponding to the 
number of reception apparatus are not served from a 
video data serving apparatus but the video stream so 
branches to a necessary number at a tree-like branch- 
ing point in the network, thereby resulting in the same 
video data being served to a plurality of reception appa- 
ratus. Specifically, when there are provided two video 
data reception apparatus as shown in FIG. 11, two ss 
video data streams are not served from a video data 
server as a transmission apparatus but a video data 
stream is duplicated at an edge router on a network 



where the network finally branching to the two client ter- 
minals, thereby resulting in the same video data stream 
being served to the two client terminals as reception 
apparatus. The video data is transmitted as described 
above, whereby a limited transmission capacity of the 
network may be utilized effectively. 
[0004] JP-A-4-003684 (laid-open on January 8, 1992) 
discloses an apparatus for encoding a motion picture 
with a variable rate for use in a videophone, video con- 
ference or the like. 

[0005] JP-A-9-1 1 6551 (laid-open on May 2, 1 997) dis- 
closes a data packet transmission method and appara- 
tus in which data packets are transmitted/received 
through an ATM network. 

[0006] JP-A-1 0-02341 8 (laid-open on January 23, 
1998), JP-A-9-247676 (laid-open on September 19, 

1997) and JP-A-1 0-032608 (laid-open on February 3, 

1998) disclose a packet video rate conversion appara- 
tus, which is particularly adapted for video conference 
communication over a network. 

SUMMARY OF THE INVENTION 

[0007] However, when the above-described conven- 
tional technology is applied to a video program service 
system, the following inconveniences may be encoun- 
ted. 

[0008] When video data is wavelet-coded and trans- 
mitted, the video transmission apparatus, according to 
JP-A-7-15609 assigns a flag to a data transmitting 
packet for each band and transmits resultant data, the 
reception apparatus decodes and reproduces only data 
having a packet with a necessary flag based on a repro- 
duction capability. For example, let us assume a video 
program service system in which the charging is graded 
by a level of reproduction quality (picture quality, 
smoothness of motion, etc.) of video data. Even when a 
reception apparatus has a video data reproduction 
capability high enough to reproduce full data transmit- 
ted from the video program service system, a viewer 
may not desire such a high reproduction quality. In such 
a case, it is desired that video data should be repro- 
duced with a reproduction quality which meets with 
viewer's requirements, in addition to the processing 
capability of the reception apparatus. However, conven- 
tionally, the reproduction quality of video data depended 
upon only the processing capability of the reception 
apparatus and the video data could not be reproduced 
with the reproduction quality which meets with viewer's 
requirements. 

[0009] Next, when there are provided a plurality of 
video program reception apparatus, according to the 
conventional IP multicast system, video data is dupli- 
cated at a branching point, and the same video data is 
served to a plurality of reception apparatus. Therefore, 
the conventional IP multicast system may not be able to 
serve video programs with different qualities to a plural- 
ity of video program reception apparatus. Moreover, 
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according to the conventional IP multicast system, when 
a plurality of video program reception apparatus 
demand to transmit the same video program with differ- 
ent reproduction qualities, video data of the same qual- 
ity, in other words, video data of the same data 
transmission rate is transmitted to a plurality of video 
program reception apparatus. As a result, a plurality of 
video program reception apparatus cannot reproduce a 
video program with different quality levels depending on 
viewer's requests. 

[001 0] Therefore, an object of the present invention is 
to provide a video program transmission and reception 
system in which a video program with a plurality of qual- 
ities can be reproduced from one video stream when a 
video program is transmitted from a video server for 
reproduction. 

[0011] It is another object of the present invention to 
provide a video program transmission and reception 
system in which, when there are provided a plurality of 
video program reception apparatus, a video stream with 
a necessary quality is duplicated by an edge router at 
edges branching to the plurality of reception apparatus 
on the network and served thereto. 
[001 2] According to an aspect of the present inven- 
tion, in a video program service system, an outputted 
video program is layered-coded, layered-coded video 
and acoustic data are stored and held in a video server 
as a video program output apparatus, the layered- 
coded data are encapsulated into packets for service, a 
flag is assigned to the to-be-served packets for each 
layer and resultant packets are transmitted. Further, a 
data rate of the layered-coded data is measured for 
each layer, a program data rate of each to-be-served 
video program quality is calculated and stored in the 
video program output apparatus, and information on 
relation between the video data rate for each to-be- 
served video program quality and the flag of the packet 
for transmitting the data necessary for reproducing each 
to-be-served video program quality is transmitted simi- 
larly to the above-described video data. 
[0013] According to another aspect of the present 
invention, in a video program reception apparatus, a 
received video program quality is demanded and a 
quality of a to-be-received video program is designated. 
[0014] According to another aspect of the present 
invention, in a reception apparatus, picture sizes of a 
plurality of displayed video programs are designated 
and displayed individually, and a video program which is 
displayed in maximum size among a plurality of dis- 
played video programs is demanded to be served with a 
high quality so that video programs of sizes other than 
the maximum size are demanded to be served with a 
low quality. 

[0015] According to another aspect of the present 
invention, in a reception apparatus, display positions of 
a plurality of displayed video programs are designated 
and displayed individually, a video program which is dis- 
played on the front plane among a plurality of displayed 



video programs is demanded to be served with a high 
quality, and video programs displayed on planes other 
than the front plane are demanded to be served with a 
low quality. 

5 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0016] 

w FIG. 1 is a block diagram showing a multi-quality 
layered video service system according to an 
embodiment of the present invention; 
FIG. 2 is a block diagram showing an encoding sec- 
tion in an embodiment of the present invention; 

15 FIG. 3 is a diagram showing a relationship between 
coded layers and flags; 

FIG. 4 is a diagram showing a relationship between 
a motion prioritized quality and a data transmission 
rate provided by a video server according to an 

20 embodiment of the present invention; 

FIG. 5 is a diagram showing a relationship between 
a resolution prioritized quality and a data transmis- 
sion rate provided by a video server according to an 
embodiment of the present invention; 

25 FIG. 6 is a pictorial representation illustrating a 
state in which examples of video programs that can 
be selected are displayed on a display screen of a 
client terminal in an embodiment of the present 
invention; 

30 FIG. 7 is a pictorial representation illustrating a 
state in which examples of video quality that can be 
selected are displayed on a display screen of a cli- 
ent terminal in an embodiment of the present inven- 
tion; 

35 FIG. 8 is a pictorial representation illustrating a 
state in which a client terminal displays received 
video programs in different display size in an 
embodiment of the present invention; 
FIG. 9 is a pictorial representation illustrating a 

40 state in which a client terminal displays received 
video programs in such a manner that display posi- 
tions overlap with each other in an embodiment of 
the present invention; 

FIG. 10 is a schematic diagram showing a system 
45 for multi-casting layered coded data in a multi-qual- 
ity layered video service system in an embodiment 
of the present invention; and 
FIG. 11 is a diagram showing a conventional IP 
multi-cast system. 

50 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

[0017] An embodiment according to the present 
invention will hereinafter be described with reference to 
55 the drawings. FIG. 1 of the accompanying drawings is a 
block diagram showing a multi-quality layered video 
service system according to an embodiment of the 
present invention. 
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[0018] As shown in FIG. 1, the multi-quality layered 
video service system according to the present invention 
comprises a video server 30 for serving a video pro- 
gram composed of video and audio data or the like, a 
video quality control equipment 20 capable of changing 
a quality of video program on the network and a client 
1 0 for receiving and reproducing a video program based 
on a video program demand. More in detail, the video 
server 30 comprises an encoding section 40 for encod- 
ing an analog video program, a data output control sec- 
tion 31 for controlling the data output, a multi-quality 
layered video section 32 for storing and holding coded 
program data, a quality index attachment section 33 and 
a data output section 34. Also, the video quality control 
equipment 20 comprises a quality demand control sec- 
tion 21, a duplication control section 22 and a data dis- 
tribution control section 23. Further, the client 10 
comprises a plurality of client terminals. In this embodi- 
ment, a plurality of client terminals assume two client 
terminals. In this assumption, an operation of a multi- 
quality layered video service system according to the 
embodiment of the present invention will be described 
hereinafter. 

[0019] The mutuality layered video service system 
shown in FIG. 1 is a system for serving the same video 
program based on video program output demands from 
one or a plurality of clients 10. In the video server 30, ini- 
tially, the encoding section 40 encodes the analog video 
program by a scalable coding method, the multi-quality 
layered video section 32 stores and holds layered- 
coded video program data, and the quality index attach- 
ment section 33 stores and holds coded information 
such as a flag for identifying each layer and a data 
transmission rate of each layer. 

[0020] FIG. 2 is a block diagram showing the manner 
in which video program data is coded and stored and 
coded information is stored. In the encoding section 40 
shown in FIG. 2, initially, a data input device 35 inputs 
data for designating a scalable coding method. 
[0021] FIG. 3 shows examples of data inputted from 
the data input device 35. The example of FIG. 3 shows 
the manner in which pictures of I picture, P picture and 
B picture are coded by two layers of a low frequency 
component (L) and a high frequency component (H), 
and also shows the manner in which flags 7 to 2 are 
assigned to each layered data. As shown in FIG. 2, a 
data signal 81 indicative of the number of layers and the 
flag inputted from the data input device 35 is transmitted 
through a CPU (central processing unit) 36 to the scala- 
ble coding section 37 and the quality index attachment 
section 33 as layer number data 82. Flag data is trans- 
mitted to the quality index attachment section 33 as flag 
data 83. After the layer number is set in the scalable 
coding section 37, the video server 30 receives, at a 
video input interface (l/F) 38, the analog video signal 80 
for encoding by a scalable coding method. The video 
input interface 38 transmits the video program thus 
received to the scalable coding section 37 as a video 



program signal 84. The scalable coding section 37 
encodes the video program signal 84 by the scalable 
encoding method designated by the aforementioned 
data input device 35. and transmits the data 85 encoded 

5 by the scalable coding to a data calculation section 39. 
The data calculation section 39 calculates a data trans- 
mission rate for each layer, and transmits the data trans- 
mission rate thus calculated to the quality index 
attachment section 33 as a data transmission rate infor- 

10 mation signal 86 of each layer. Also, the data calculation 
section 39 transmits the data 85 encoded by the scala- 
ble coding to the multi-quality layered video section 32. 
The multi-quality layered video section 32 stores and 
holds the data 85 encoded by the scalable coding thus 

15 transmitted. The quality index attachment section 33 
forms combinations of a total data transmission rate of 
each video quality and flags necessary for realizing the 
reproduction of each quality from the layer number data 
82 inputted from the data input device 35, the flag data 

20 83 and each layer data transmission rate information 86 
from the data calculation section 39. 
[0022] FIGS. 4 and 5 show tables of flags necessary 
in respective qualities and total data transmission rates 
thus formed. A study of FIGS. 4 and 5 reveals that two 

25 kinds of quality modes of motion prioritized mode and 
resolution prioritized mode are set in this embodiment. 
[0023] In the motion prioritized mode shown in FIG. 4, 
there are set motion prioritized quality modes of six 
stages ranging from a motion prioritized quality mode 1 

30 to a motion prioritized quality mode 6. Flags 7 to 2 in 
FIG. 4 represent low frequency components and high 
frequency components of respective I, P and B pictures 
as mentioned before in FIG. 3. While reference numer- 
als 1 are attached to all components from the flags 7 to 

35 2 in the quality of the motion prioritized mode 1, for 
example, these reference numerals 1 mean that the 
quality of the motion prioritized mode 1 contains six 
components of low frequency components and high fre- 
quency components of all I, P, B pictures. Also, in the 

40 quality of the motion prioritized mode 3, for example, the 
I picture contains both of the low frequency components 
and the high frequency components, and the P picture 
and the B picture contain only the low frequency compo- 
nents. A total data transmission rate on the right-hand 

45 end column of the table shown in FIG. 4 represents a 
value which results from accumulating respective layer 
data transmission rates from the data calculation sec- 
tion 32 in FIG. 2. In the quality of the motion prioritized 
mode 1 , for example, there is illustrated the total data 

so transmission rate of 6.0 Mbit/s. In the quality of the 
motion prioritized mode 4, for example, there is illus- 
trated the total data transmission rate of 4.2 Mbit/s. 
[0024] In the resolution prioritized mode shown in FIG. 
5, there are set resolution prioritized quality modes of 

55 six stages ranging from the resolution prioritized mode 1 
to the resolution prioritized mode 6. The flags and the 
total data transmission rate in FIG. 5 represent mean- 
ings similar to those described in FIG. 4. That is, while 
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the quality of the resolution prioritized mode 3 contain 
the low frequency components and the high frequency 
components of I and P pictures, the B picture contains 
neither the low frequency component nor the high fre- 
quency component. Also, a total data transmission rate 5 
means that there exist data of 5.0 Mbit/s. 
[0025] Next, the manner in which video programs are 
served in response to video program serving demands 
from the two client terminals will be described with ref- 
erence to FIG. 1. 10 
[0026] Initially, the video program client terminals 1 1 
and 12 issue desired video program serving demands 
to the video server 30 by using the video program serv- 
ing demand signals 51, 52. FIG. 6 shows a state in 
which examples of video programs that can be selected 15 
from the video program guide are displayed on the client 
terminals 1 1 and 12. Initially, a viewer selects a desired 
video program on the video program selection picture 
shown in FIG. 6. For example, let it be assumed that the 
client terminals 1 1 and 12 select a video program A. In 20 
this case, the client terminals 1 1 and 12 issue a serving 
demand of the video program A to the video server 30. 
When the video program client terminals 11 and 12 
issue the video program serving demands to the video 
server 30, the video program serving demands are 25 
transmitted through the quality demand control section 
21 within the video quality control equipment 20 existing 
on the network to the data output control section 31 
within the video server 30 as the video program serving 
demand signal 60. The quality demand control section 30 
21 stores and holds information of video programs 
demanded by the video program client terminals 1 1 and 
12 in the internal memory. That is, the video quality con- 
trol equipment 20 stores and holds information indicat- 
ing that the video program A is demanded by the client 35 
terminals 11 and 12. The quality demand control sec- 
tion 21 transmits data indicative of making a duplication 
to serve video program data to a duplication control sec- 
tion 22 by using a control signal 62. Further, a data dis- 
tribution control section 23 is controlled by a control 40 
signal 63 in such a manner that data duplicated by the 
duplication control section 22 is served to the client ter- 
minals 11 and 12. 

[0027] When the data output control section 31 within 
the video server 30 receives the video program service 45 
demand signal 60, the data output control section 31 
instructs the quality index attachment section 33, which 
stores and holds coding information such as flags of 
respective layers in which video programs are coded 
and data transmission rates for respective layers, by so 
using a control signal 72 in such a manner that the qual- 
ity index attachment section 33 outputs coding format 
information. When the quality index attachment section 
33 receives the coding format information output 
instruction signal 72 from the data output control section 55 
31 , the quality index attachment section 33 transmits 
the coding format information thus stored and held such 
as the flags of the respective layers and the data trans- 



mission rates of the respective layers, i.e. information 
described in FIGS. 4 and 5 to the data output section 34 
as a coded information signal 74. The data output sec- 
tion 34 encapsulates the coding format information 
received from the quality index attachment section 33 
into a packet, and transmits the same to the video qual- 
ity control equipment 20 as the coding format informa- 
tion signal 61. The duplication control section 22 within 
the video quality control equipment 20 stored and holds 
the coding format information signal 61 received from 
the data output section 34, i.e. the coding information 
such as the flags of the respective quality modes and 
the data transmission rates of the respective quality 
modes in the internal memory, duplicates the coding for- 
mat information, and transmits duplicated coding format 
information signals 64 and 65 to the data distribution 
control section 23. The data distribution control section 
23 transmits the coding format information transmitted 
from the duplication control section 22 to the client ter- 
minals 1 1 and 12 as the coding format information sig- 
nals 66 and 67. 

[0028] When the client terminals 11 and 12 receive 
the coding format information signals 66 and 67, the cli- 
ent terminals 11 and 12 display the picture shown in 
FIG. 7 on the display screen. Since the user initially 
demands the service of the video program A, there are 
displayed a quality mode that can be provided in the 
video program A and a data transmission rate on the 
display screen. Then, the user selects a quality mode 
and a reception data transmission rate corresponding to 
the video program A shown in FIG. 7. 
[0029] In actual practice, the user selects the right- 
hand side data transmission rate portion on the picture 
of FIG. 7 displayed on the display screen of the client 
terminals, i.e. a quality of 6.0 Mbit/s at the motion prior- 
itized quality mode 91 (i.e. "motion prioritized mode 1 " in 
FIG. 4) is selected in the client terminal 1 1 . Also, a qual- 
ity of 5.7 Mbit/s at the resolution prioritized quality mode 
92 (i.e. "resolution prioritized mode 2" in FIG. 5) is 
selected in the client terminal 12. In this case, the client 
terminals 11 and 12 issue the video program demands 
with the selected quality modes to the video server 30 
by using the demand signals 51 and 52. 
[0030] When the client terminals 1 1 and 12 issue the 
video program demands with the quality modes 
selected by the respective client terminals 11 and 12 to 
the video server 30, a video program output instruction 
is supplied through the quality demand control section 
21 within the video quality control equipment 20 existing 
on the network to the data output control section 31 
within the video server 30 as the video program service 
demand signal 60. The quality demand control section 
21 stores and holds quality mode information of the 
video programs demanded by the video program client 
terminals 1 1 and 12 in the internal memory. The quality 
demand control section 21 stores and holds the infor- 
mation such that the client terminal 1 1 ordered the qual- 
ity mode information indicating that the quality mode 
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video program of 6.0 Mbit/s in the motion prioritized 
quality mode of the video program A in the internal 
memory, and the information such that the client termi- 
nal 12 ordered the quality mode information indicating 
that the quality mode video program of 5.7 Mbit/s in the 
resolution prioritized quality mode of the video program 
A in the internal memory. 

[0031] Also, the quality demand control section 21 
transmits the quality information demanded by the video 
program client terminals 11 and 12 to the duplication 
control section 22 by using the control signal 62. Fur- 
ther, the quality demand control section 21 controls the 
data distribution control section 23 by the control signal 
63 in such a manner that the data distribution control 
section 23 may serve data generated by the duplication 
control section 22 to the client terminals 1 1 and 12. 
[0032] When the data output control section 31 within 
the video server 30 receives the video program service 
demand signal 60, the data output control section 31 
transmits a demanded video program output instruction 
to the multi-quality layered video section 32 which 
stores and holds the video program data encoded by 
the scalable coding method through the control signal 
71. When the multi-quality layered video section 32 
receives the video program output demand signal 71 
from the data output control section 31 , the murti -quality 
layered video section 32 transmits the stored and held 
video program data encoded by the scalable coding 
method to the data output section 34 as the coded data 
signal 73. The data output section 34 encapsulates the 
layered-coded data received from the multi-quality lay- 
ered video section 32 into the packet by assigning the 
flag of each layer, and transmits the resultant packets to 
the video quality control equipment 20 as the coded 
data signal 61 . Incidentally, as a system for assigning 
the flag of each layer, there may be used a TOS (Type of 
Service) field within the header of IP packet when the 
data encoded by the scalable coding method is encap- 
sulated into the IP packet, for example. 
[0033] The duplication control section 22 within the 
video quality control equipment 20 compares the video 
program quality modes, demanded by the client termi- 
nals 11 and 12, transmitted from the quality demand 
control section 21 with the coding format information ini- 
tially received from the video server 30, and forms 
(duplicates) layered-coded data necessary for serving 
the video programs of the quality modes demanded by 
the client terminals 1 1 and 1 2 from the received layered- 
coded data 61. 

[0034] In this embodiment, since the client terminal 1 1 
demands the quality mode of 6.0 Mbit/s in the motion 
prioritized quality mode of the video program A, the 
duplication control section 22 duplicates data of packets 
having the flags 7 to 2 (i.e. all packets), and transmits 
the data thus duplicated to the data distribution control 
section 23 as the video program data 64 demanded 
from the client terminal 1 1 . Accordingly, in this case, the 
quality mode need not be changed and the received 



data is transmitted to the data transmission section 23 
as the demanded video program data 64 as it is. Also, 
since the client terminal 12 demands the quality mode 
of 5.7 Mbit/s in the resolution prioritized mode of the 

s video program A, the duplication control section 22 
duplicates data other than data of the high frequency 
component of the B picture, i.e. data except the packet 
having the flag 2 from the received data encoded by the 
scalable coding method 61 , and transmits the data thus 

w duplicated to the data distribution control section 23 as 
the video program data demanded from the client termi- 
nal 12. The data distribution control section 23 transmits 
the data encoded by the scalable coding method 64 and 
65 transmitted from the duplication control section 22 to 

is the client terminals 11 and 12 as the video program 
service data signals 66 and 67. 
[0035] FIG. 10 illustrates the state in which the video 
program A is multicast on the client terminal 1 1 which 
demands the quality mode of "motion prioritized quality 

20 mode 1" selected from the video server 30 and the cli- 
ent terminal 12 which demands the quality mode of 
"resolution prioritized quality mode 2" selected from the 
video server 30. As described above, the high fre- 
quency component of the B picture is not transmitted to 

25 the client terminal 12. The client terminals 11 and 12 
receive the video program data signals 66 and 67 out- 
putted from the video quality control equipment 20, and 
display the video program data thus received on the dis- 
play screens thereof. 

30 [0036] While the display size of video program dis- 
played by the reception terminal has not been described 
so far, it is possible to automatically set the quality mode 
of the received video program based on the display size 
of video program displayed on the client terminal. For 

35 example, if the display size of the video program dis- 
played on the client terminal is less than a certain size, 
it is possible to construct the system in such a manner 
that the system may automatically receive video pro- 
gram data of the quality modes having only the low fre- 

40 quency components of the I, P, B pictures, i.e. the video 
program quality of the motion prioritized quality mode 4. 
Also, the system may be extended even when the client 
terminal receives a plurality of video programs. 
[0037] FIGS. 8 and 9 are respectively pictorial repre- 
ss sentations showing the manner in which video pro- 
grams are displayed on the display screen of the client 
terminal when the client terminal receives a plurality of 
(two video programs) video programs. 
[0038] FIG. 8 shows the manner in which two video 

so programs are received through the coded data signal 
66, i.e. a video program 1 denoted by reference numeral 
101 is reproduced and displayed on a small window and 
a video program 2 denoted by reference numeral 102 is 
reproduced and displayed on a large window. When the 

55 display sizes of the received video programs are differ- 
ent as described above, the video server 30 may be 
demanded by the video program demand signal 51 so 
as to serve video programs in such a manner that a 
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video program which is to be displayed in maximum size 
may be displayed with a video program quality desig- 
nated by the user or with the best quality that can be 
provided and that video programs which are to be dis- 
played in other sizes may be displayed with a quality 5 
lower than that of the video program displayed in maxi- 
mum size or with the lowest quality that can be pro- 
vided. 

[0039] FIG. 9 shows the manner in which a video pro- 
gram denoted by reference numeral 104 is reproduced 10 
and displayed on the front window and a video program 
1 denoted by reference numeral 103 is reproduced and 2. 
displayed on the rear window. When the displayed posi- 
tions of the received video programs on the display 
screen are different as described above, the video 15 
server 30 may be demanded by the video program 
demand signal 51 so as to serve video programs in 
such a manner that a video program which is to be dis- 
played on the front may be displayed with a video pro- 
gram quality designated by the user or with the best 20 
quality that can be provided and that video programs 3. 
which are to be displayed at other positions may be dis- 
played with a quality lower than that of the video pro- 
gram displayed on the front or with the lowest quality 
that can be provided. 25 
[0040] As described above, according to the multi- 
quality layered video service system in one aspect of 
the present invention, a video program which is to be 
served is layered-coded, the flag is assigned to each 
layer, and then the video program is served. Also, in 30 
order to reproduce video programs with a plurality of 
quality modes, information indicating a combination of 
flags for serving data necessary for reproducing video 
programs with respective quality modes are served 4. 
together with video programs data. Therefore, there can 35 
be achieved the effects to provide the video program 
transmission and reception system capable of repro- 
ducing video programs with a plurality of quality modes 
from one stream data which results from video pro- 5. 
grams data encoded by the scalable coding method. 40 
[0041] Having described a preferred embodiment of 
the invention with reference to the accompanying draw- 
ings, it is to be understood that the invention is not lim- 
ited to that precise embodiment and that various 
changes and modifications could be effected therein by 45 
one skilled in the art without departing from the spirit or 
scope of the invention as defined in the appended 
claims. 6. 

Claims so 

1 . A video program serving system comprising: 

a video server (30); and 

a video quality control equipment (20) con- 55 
nected to said video server (30) and a plurality 7. 
of client terminals (11, 12) through a network, 
wherein said video server (30) includes means 



(34) for encapsulating video data, encoded by 
a scalable coding method, into packets and 
outputting said packet with a flag for each layer, 
and said video quality control equipment (20) 
includes means (22) for duplicating data, which 
results from combining encoded data of differ- 
ent layers, from one video data, encoded by the 
scalable coding method, received from said 
video server (30) and for transmitting it for each 
client terminal. 

A video program serving system according to claim 
1, wherein said video server (30) includes means 
(33) for measuring a combination of said flags and 
data transmission rates of encoded data corre- 
sponding to said combination and means (34) for 
transmitting information concerning said measured 
data transmission rate through said video quality 
control equipment (20) to a client terminal (1 1,12). 

A video server (30) comprising: 

means (34) for encapsulating video data, 
encoded by a scalable coding method, into 
packets and outputting said packet with a flag 
assigned for each layer; and 
means (33) for encapsulating information con- 
cerning a combination of flags and a data 
transmission rate of data, encoded by the scal- 
able coding method, corresponding to said 
combination into packets and outputting said 
packets. 

A video server (30) according to claim 3, further 
comprising means (40) for measuring a data trans- 
mission rate for each layer of said video data 
encoded by the scalable coding method. 

A video quality control equipment (20) comprising: 

means (22) for duplicating video programs of 
quality different for each client terminal (11, 
12), from one video data, encoded by a scala- 
ble coding method, received from a video 
server (30) and serving said duplicated video 
programs. 

A video quality control equipment (20) according to 
claim 5, further comprising means (22) for duplicat- 
ing data which results from combining encoded 
data of different layers for each client terminal (11, 
12), from one video data, encoded by the scalable 
coding method, received from a video server (30) 
and transmitting said duplicated data. 

A video program receiving apparatus (10) compris- 
ing: 
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means (11, 12) for receiving information con- 
cerning a data transmission rate obtained 
when a video program transmitted from a video 
server (30) is displayed with a first quality mode 
and information concerning a data transmis- 5 
sion rate obtained when said video program is 
displayed with a second quality mode lower 
than said first quality mode and displaying said 
information on a display screen; and 
means for selecting said first quality mode and 10 
said second quality mode from said display 
screen. 

8. A video program receiving apparatus according to 
claim 7, further comprising: 15 

means (11, 12) for receiving first and second 
video programs from said video server (30) 
through a network and displaying said first and 
second video programs on said display screen 20 
in a multi-window fashion; and 
means for demanding that said first video pro- 
gram Is served with said first quality mode and 
said second video program is served with said 
second quality mode when a window size for 25 
displaying said first video program is larger 
than a window size for displaying said second 
video program. 

9. A video program receiving apparatus according to 30 
claim 7, further comprising: 

means (11, 12) for receiving first and second 
video programs from a video server (30) 
through a network and displaying said first and 35 
second video programs on said display screen 
in a multi-window fashion; and 
means for demanding that said first video pro- 
gram is served with said first quality mode and 
said second video program is served with said 40 
second quality mode when a window for dis- 
playing said first video program is located 
ahead of a window for displaying said second 
video program. 
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